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Abstract 

This paper considers the problem of transmitting the difference of two jointly Gaussian sources over a two-user 



00 

' additive Gaussian noise multiple access channel (MAC). The goal is to recover this difference within an average 

^SJ ■ mean squared error distortion criterion. Each transmitter has access to only one of the two Gaussian sources and 
is limited by an average power constraint. In this work, a lattice coding scheme that achieves a distortion within 

. a constant of a distortion lower bound is presented if the signal to noise ratio (SNR) is greater than a threshold. 

' Further, uncoded transmission is shown to be worse in performance to lattice coding methods. An alternative lattice 

1^ . coding scheme is presented that can potentially improve on the performance of uncoded transmission. 

L Introduction 

In this paper, we consider the joint source channel coding problem of transmitting the difference of two 
c/j positively correlated Gaussians in a distributed fashion over an additive Gaussian noise multiple access 
channel (MAC). Each transmitter in the MAC has, as its message, one component of the bivariate Gaussian 
. source and its codebook is constrained by a second moment (average power) requirement. We estimate 
^ ! the difference between the two correlated sources while incurring the lowest possible mean squared error 
^ ■ at the receiver. The distortion suffered by the difference between the two sources is a function of the 
^ power constraints at the two transmitters as well as channel statistics. In general, there is no separation 
^ . between source and channel coding over MACs, and a joint coding scheme is desired. 

I There has been significant related work on both the source and channel aspects of this problem. In [[T]|, 
the authors consider the problem of communicating a bivariate Gaussian source over a Gaussian MAC to 
recover both components limited by individual distortion constraints. In [2], the problem of recovering a 
single Gaussian source through a Gaussian sensor network is considered. Subsequently, the authors also 
address the problem communicating the sum of independent Gaussian sources over a Gaussian MAC in 

X; 0. 

■ In the domain of source coding, Pl considers and solves the two terminal Gaussian source coding 
problem while a distributed lattice based coding scheme for reconstructing a linear function of jointly 
Gaussian sources is developed in Q. In an outer bound on the rate region for the distributed 
compression of linear functions of two Gaussian sources for certain correlations is presented. This bound 
indicates that existing achievable schemes are suboptimal. 

In this work, we present a lattice coding scheme for the distributed transmission of the difference of 
Gaussians over the MAC. Note that, for a different setting, lattice codes have been previously considered 
for joint source-channel coding in [|7]|. The key contributions of this paper are as follows: 

1) We present a lower bound on the distortion incurred while estimating the difference between the 
sources over a Gaussian MAC. This lower bound is based on augmenting the receiver with a 
random variable that induces conditional independence between the two sources and considering a 
statistically equivalent system of two parallel channels from each of the transmitters to the same 
receiver. This genie aided bound is based on the work in and H where the authors determine 
a lower bound on distortion in a source coding setting. 



2) We develop a lattice coding scheme for communicating the difference of the two sources over this 
channel. The scheme we present for the MAC is similar in spirit to the scheme in [|3l and is an 
extension of [3J to correlated sources. 

3) We show that our scheme performs "close" to the lower bound by showing that the logarithm of 
the ratio of the distortion achieved to the distortion lower bound is 1 bit if the signal to noise ratio 
(SNR) is greater than a threshold. We show that the lattice based transmission scheme provides an 
improvement in distortion over uncoded transmission. 

4) Finally, we propose a common dither based lattice coding scheme in which the channel inputs of 
the two users are correlated (by using the same dither). This correlation can potentially reduce the 
distortion and can therefore come closer to the lower bound in terms of performance. 

The rest of the paper is organized as follows. We develop the system model and notation in Section 
ini We present a lower bound on achievable distortion in Section Unl In Section |IVl we characterize 
the distortion achieved using an uncoded transmission scheme. In Sections |V] and |VI] we describe the 
scaled lattice and common dither based lattice coding schemes and analyze their performance. Finally, 
we conclude the paper with Section |VII[ 

II. System Model and Notation 

We briefly explain the notation used in this paper before presenting the system model. We use capitals 
to denote random variables and boldface capitals to denote matrices. E is used for expectation of a random 
variable while we refer to an n-length vector as x". Throughout the paper, logarithms used are with respect 
to base 2 and the square of the 2-norm of an n-length vector is denoted as 
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The system model is depicted in Fig. 1. Consider independent and identically distributed (i.i.d) n- 
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Fig. 1. System Model 



length sequences of Gaussian random variables, {5'i(i)}"^^ and {5'2(z)}"=i. The covariance matrix of 

(5*1 (z), 5*2(0) is given by 



a 

pa' 



pa^ 
a' 



for all i = 1,2, Without loss of generality, we assume p > for the purposes of this paper. 
Transmitter k in the MAC has a realization of 5^ for k = 1,2. Also the number of source samples 
observed is equal to the number of channel uses available. Thus, the system has a bandwidth expansion 
factor of 1. The channel input sequence at each user is a function of the observed source sequence such 



that a power constraint is satisfied. Mathematically, the channel input = fk{.{Sk{'i)}i=i) for 

k = 1,2. The power constraint is expressed as 

i=i 

The noise {Z[i)}'^^-^ is a sequence of i.i.d Gaussian random variables with zero mean and variance A^. 
The received signal at time instant i is given by 

=Xi(2)+X2(i) + Z(i). 

We wish to estimate the sequence of the difference {Si{i) — S2{i)}^^i at the receiver given the received 
sequence within a distortion. The distortion metric considered is the time average mean squared 

error. Let S'3(i) = Si{i) — 82(1) and the estimated sequence be {Ss{i)}^^^. The distortion D is defined as 

1 " 

D = -Y.E[{S,{z) - Ss{^)n 
Next, we present a lower bound on D. 

111. Lower Bound on Distortion When Determining the Difference of Jointly Gaussian 

SOURCES 

We now present a lower bound on the distortion incurred for the distributed transmission of the difference 
of correlated sources. One of the ideas used in the proof is augmenting the receiver with a random variable 
that induces conditional independence between Si and S2 as presented in BH. We consider the following 
representation for the Gaussian sources (S'l, S2): 

51 = ^S + Vi 

52 = ^/pS + V2. 

where S, Vi and V2 are independent Gaussian random variables with mean zero and variances cr^, — p) 
and (7^(1 — p). Note that, by supplying the receiver with the sequence S*", the distortion incurred can only 
decrease. 
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Fig. 2. Parallel channels 



Further, we lower bound the distortion by considering a modified channel setting as shown in Fig. 2. 
This modified channel is a memoryless Gaussian channel which at time i is represented mathematically 
as 



ri(z) = Xi(z) + Zi(z) 

¥2(1) = X2i{} + Z2i{} 



Therefore, 



where Zi{i) and Z2{i) are Gaussian random variables with mean zero and variance N/2, independent 
of each other and of Xi(i) and X2{i). The receiver obtains an estimate of the difference based on the 
observations of the vector {¥{',¥2). The distortion incurred on this channel is a lower bound on the 
distortion resulting from the original channel. In the original channel, the output X" + + is a 
function of the output of the modified channel, which is the vector (X" + Z",X2 + Z2 ). Note that the 
output of the original channel (in Fig. 1) and the sum of the outputs of the modified channel (in Fig. 2) 
are statistically equivalent. 

The distortion incurred in the modified channel with side information 5" at the receiver satisfies: 
1 " 

D >-$:E[(5r(z) -^^"(z) -E[5r(z)|5",yi(z),F2(0] +E[52"(^)|5",yi(0,F2(0])1 
1=1 

1 " 

-2E[(5r(0-E[5r(^)|^",ri(2),r2(0])(^2"(0-E[^2"(0l^",>^i(^),>^2(0])]. 
The following Markov condition 

Fi" ^ ^ S"^ ^ 5" ^ ^2" ^ ^2 ^ (1) 

implies that 

nSl{i)\S'^,¥^{i),¥2{i)\=nSl{i)\S''.¥^{i)\ 
E[52"W|5",ll«,r2«]=E[5r(z)|^",y2«]. 

1 " 

1=1 

-2E[(5r(^)-E[5r(^)|5^Fl(^)])(52n^)-E[52"(^)|5^y2(^)])]. (2) 

We observe that 

-f^n.Sl{^)-nSl{^)\S\¥,{^m = ^^^^ 

^ i=l + TV 

-Y.E[{S-{z) -E[S-{^\S\¥2m'] = \ (3) 

since these are the average squared error distortions in 5*" and 5*2 when each is transmitted over a 
point to point Gaussian channel with noise variance X/2, power constraint P and conditional variance 
Var(5i|5) = Var(Vi) = C7^(l -p) and Var(52|5) = Var(V^2) = cr'^{l-p)- Now, the following conditional 
cross correlation, 

E[(5r(z) -E[5r(z)|5",ri(z)])(52"(z) -E[52"(z)|5",F2(0])|51 
=E[(5rW -E[5r(z)|5",ri(z)])|^"]E[(52"(z) -E[^2"(0|5",y2(z)])|5"] 

due to the Markov condition stated in ([T]). But, by tower rule for expectations, we have 

E[{Sn^) - E[5r(z)|5",Fi(z)])|5T = a.s, 

for alH = 1, 2, . . . , n. Thus 

E[(5I^(z) -E[5i"(z)|5",ri(z),F2W])(^2(0 -E[52"(z)|5",Fi(z),y2W])|51 = a.s. 
^E[(5r(0 -E[^i"(^)|^",Fi(^),r2«])(^2(0 -E[^2"(^)l^",>^i(0,>^2«])] = 0, (4) 



By combining Q, © and (31), we get 



2a\l-p) 

J-^bound ^ 2P 



In the following sections, we discuss the performance of various achievable schemes relative to this 
distortion bound. 

IV. Uncoded Transmission 

In this section, we compute the distortion resulting from uncoded transmission in order to communicate 
the difference {Si{i) — S2{i)}^=i- In this setting. Transmitter 1 sends a scaled version of the source 
^J^Si{i) at time instant i and Transmitter 2 sends —\f^S2{i) at time instant i. The scaling is chosen 
such that both users satisfy their respective power constraints. The received sequence is given by 




The receiver determines the minimum mean squared error (MMSE) estimate of the difference Si{i) — S2{i) 
based on the received signal Y{i). The distortion resulting from this process can be calculated as 

1. 



D =-E[||53"-E[^3"|F"] 



n 



(2v^(l-p))^ 
2P{l-p) + N 



. I 2P(l-p) - 



Note that the distortion resulting from by uncoded transmission does not meet the lower bound for any 
p > 0. In the next two sections, we describe lattice based coding schemes which perform better than 
uncoded transmission (thus resulting in a lower distortion). 

V. Lattice Coding Scheme 

We now describe a scaling based lattice scheme to communicate the difference of the two sources. An 
implicit assumption that we make in the study and design of lattice schemes is that P < a^. In effect, 
for P > a^, the lattice quantization scheme presented below reduces to uncoded transmission. We briefly 
review some features of lattice codes and quantizers before we present the scheme. A lattice of dimension 
n is defined as the set 

A = {x = zG : z eZ""} 

where G G Z"^" is known as the generator matrix and Z is the set of all integers. The quantized value of 

X E W^, Q{x) = argmin^gy\^||x — r||. The second moment of a lattice is defined as cr^(A) = "^^^y^^j^- The 

fundamental Voronoi region of A is defined as = {x E MJ^ : Q{x) =0}. Further, we use the notation 
xmod A = X — Q{x). 

The lattice coding scheme described below is similar in nature to the lattice coding scheme used in 
ll3l for joint source channel coding of the sum of independent Gaussian sources. Consider A, a lattice of 
dimension n with second moment o"^(A) = P. We choose the same lattice A at both the users such that it 
is good for both source and channel coding. The proof of existence of such a lattice and its construction 
are detailed in |[8l. Let Ui and f/^ be independent dithers (independent of themselves and independent 



of the sources) which are uniformly distributed over the fundamental Voronoi region and known at the 
receiver. The n-length channel input at each transmitter is 

= (75i"-f/nmodA 
X^={-^S^-U^)modA 

where 7 is a scalar which is chosen later. 
The signal at the receiver is given by 

y" = + + Z". 

The decoder performs the following operations to estimate the difference. 

17 =[aF" + f/f + U^] mod A 

= [a(Xf + + Z") + f/f + U^] mod A 
= [7(5r - S^) + {a- l)((75r - t/D mod A 

+ (-752 - U^) mod A) + aZ"] mod A 
= [^{S^-S^) + Z^]modA, 

where 

= (a - l)((7Si" - U^) mod A + (-7^2" - ^2") mod A) + aZ*^ 

is the effective noise. Note that each term in the effective noise is independent of the source since the 
dither is chosen uniformly in the fundamental Voronoi region and independent of the sources flUl and the 
original noise is also independent of the sources. By choosing a = 2p^n ' '•^^ MMSE coefficient, we 
reduce the variance of the effective noise to ^p+n - ■^mce A is chosen to be a good channel lattice, if 

7^2a^(l-p)+ <P, (5) 

we know from [[TOll that we can decode correctly and 

[^(5- _ s^) + z^] mod A = 7(5r - ^2") + ^r- 

Therefore, if ^ > |, we choose 7 satisfying ([5]) with equality. Mathematically, 7 satisfies 

9 , 2PN 

^,^-2aM-,)^-^ + l = ^-^. (6) 
Under the assumption of correct decoding, we have 

= 7(5f - 52") + . 

We now multiply the received signal by where K = 2pn+2ctHi-^)-i'^{2P+n) ' '•^ obtain 

4" = ^^(7^3+^1") 
l-K 

= SI - Ksi + — ^^r- 



The average distortion that is achieved is simply the time average of the expectation of the two norm of 
^— ^Z" — KS^, which can be calculated as 



lattice 



n 

. 2a^(l~p)7^(2P+jV) 
~^ 2PN 

Z . i • 

TV ^ 2 

where the last equality follows from 

The lattice based coding scheme developed above is close to the distortion bound presented in Section 
Hill in the sense that the logarithm of the ratio of the distortion bound to distortion resulting from the 
lattice scheme is one bit for any SNR > |. This is because 

Dlamce , 2(7^(1 -p) 1 + f 

log 7^ = log P , 1 o 2n ^ = = 1. 

The SNR condition is necessary for the existence of the above lattice scheme as discussed earlier. 

VL Common Dither based Lattice Coding Scheme 

We now propose an alternative lattice coding scheme based on using a common dither at both the 
terminals. Let t/" be the common dither at both the terminals and the rest of the parameters of the lattice 
code are the same as in the previous section. The channel input at each user is given by 

= (5r-f/")modA 
= -(52™ -f/")modA. 

We know that XJ^ is independent of 5*^ for /c = 1, 2 and is uniformly distributed over the fundamental 
Voronoi region of the lattice A [|9||. However and are no longer independent. Let p' denote the 
correlation coefficient between X^ and . In this scheme, we perform the same sequence of operations 
at the receiver as in the previous lattice based scheme. Thus we obtain 

= [S'l - + Z"^] mod A, 

where 

Z^' = {a- - f/") mod A - (^2" - f/") mod A) + aZ"" 

is the effective noise. By choosing a = 2P^i+p')+N ' '•^^ variance of can be reduced to 2P{i+p')+n - 
Again, as before, the effective noise term is independent of S*" — S'2. Moreover, [S^ — S2 + Z"] mod A = 

SI - s'i + z^ if 

^'-^) + 2P(l + p') + iV-^- 
Thus we will be able to decode correctly for all P, N, p and p' satisfying the above equation. Multiplying 
the signal by 1 — K where K = 2P{l+p')N+^2a^l-p)(2P{l+p')+N) ' distortion can be calculated 



similarly as 

E[\\{1 -K)Z^~KS^f] 



D 



n 

.2/ 



2a\l-p) 



2(T2(i„p)(2P(l+p')+Af) 
2P{l+p')N 



In general, the distortion resulting from the common dither based scheme is better than that resulting 
from the independent dither based scheme. This improvement depends on p', the correlation between the 
channel inputs. Characterizing p' is in general a non-trivial task as it depends on both source and channel 
parameters, and is therefore left uncharacterized in this paper. 

VII. Conclusion 

We present two lattice coding schemes for the distributed source channel communication of the differ- 
ence of two jointly Gaussian sources. In the scaling based lattice coding scheme, we show that we can 
find the scaling parameter 7 to achieve a distortion very close to the lower bound on the distortion if 
SNR > |. Future work includes exploring lattice based schemes to compute more general linear functions 
of correlated Gaussian sources over a MAC. 
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